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ABSTRACT 

The manual of classroom observation techniques is 
intended to provide observers with detailed descriptions of 
standardized procedures and techniques involved in sequential data 
collection in a classroom. Focus is on obtaining reliable data on 
sequential interactions between teachers, peers, and subjects (each 
of the students in turn is a subject). The coding procedure described 
identifies behaviors of teachers and peers preceding and following 
the subject's behavior. Guidelines are given concerning proper 
equipment function, maintenance of good relations with school 
personnel, and timing within observations. The observer's actions 
before, during, and after an observation are specified. How to fill- 
in the coding sheet is explained in detail, as is the proper sequence 
of coding behaviors. Definitions of the abbreviated observation codes 
used to describe peer antecedent behaviors, teacher antecedent 
behaviors, s\ 2 bject responses, and peer/teacher consequences are 
given. Included is a descriptive version of class activity during a 
reading period, with completed coding sheets. Finally, procedures are 
outlined for checking the reliability of observational data. (KW> 
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CODING 11ANUAL FOR SUDJECT/PEER/TEACHER SEQUENTIAL INTERACTIONS 
IN ACADEMIC SURVIVAL SKILL SETTINGS 
Joseph A. Cobb and Hyman Hops^^^ 

Introduction 

This manual has been written to provide observers with a detailed 
description of the procedures and techniques required for sequential 
data collection in an academic setting. Standardized procedures are 
necessary for the gathering of observation data to maximize the likeli- 
hood that results based upon the data have wide practical and theor- 
etical applications. By minimizing procedural difference it seems 
possible to compare data collected by different observers. The pro- 
cedures include Interactions with academic personnel, timing within 
observations, and reliability checks. It Is hoped that this manual 
will provide the framework from which excellent data can be generated. 

The observer Is viewed as the keystone of data collecting In 
the behavioral approaches to problem solution. In more traditional 
approaches the use of tests have served a similar purpose that now Is 
served by observers. The test examiner used a standardized procedure 
for administering a test to reduce differences In the test situation 
from subject to subject. In addition, subjects were required to re- 
spond to similar test Items. In observation work the procedures used 
by observers parallel the test administration procedures and the be- 
havioral codes used by the observers parallel the test Items. A de- 
tailed description of the former Is provided In order that each ob- 
server will apply the same procedures before, during, and following 
the classroom observation. 
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The "test Item" definitions must be clear and concise In order that 
vjlthln and across observers the same "test Items" are being applied. 

If the definitions are unclear then the possibility arises that dlf- 
ferent observers may use the same "test Item" for different behaviors. 
While the test Items In traditional assessment are set> the possibil- 
ity exists that the "test Items" may fluctuate day by day In an ob- 
servational procedure not because the definition has changed but be- 
cause the definition used by the observer has changed. Thus> there 
Is need for constant and systematic feedback concerning any discre- 
pancies or lack of discrepancies between an observer's definition 
and those specified In the manual. In order to determine If such 
discrepancies exist » a plan for checking reliability will be detailed. 

The manual's content Is specifically tailored to produce re- 
liable data on sequential Interactions between teachers, peers, and 
subjects . During an observation each student becomes a subject for 
a specified time period and his (her) behavior > as well as the be- 
haviors of peers and teacher » Is observed and coded. The coding pro- 
cedure Is accomplished In a manner designed to Identify behaviors 
of teachers and peers preceding and following the subject's behavior; 
thus> a sequential pattern can be obtained detailing the antecedent 
and consequent events of any subject's behavior. 

Procedures for Observing In an Academic Situation 

The following are a list of guidelines to be followed by the 
observer to assure smooth data gathering through proper equipment func- 
tioning and by establishing and maintaining excellent relations with 
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school personnel. 

A. Before an Observation 

1. Check that the timing device used to produce auditory 
signals is set and working accurately. The device should be routinely 
checked at weekly Intervals and at any other time that an observer thinks 
the device may not be functioning. When the auditory device is not 
being used make sure that it Is disconnected . The device runs on 
batteries and can drain the batteries rapidly if left on for any per** 
lod of time. 

2. Be sure you know where the school is located before 
leaving the office. The use of a map or a check with other people 
who have been to the school should reduce the chance of getting lost 
and missing an observation. Have the name, telephone nuniber and the 
address of the school on a sheet of paper that is to be taken to the 
observation. If you become lost, telephone the school so that a 
staff member can direct you there. 

3. Check before leaving the office to be sure you have 
an auditory timing device, an earphone, a clipboard, two sharp pen- 
cils, and an adequate supply of coding sheets, 

4. Plan to arrive on the school grounds fifteen minutes 
prior to the time that an observation is to begin. This will allow 
enough time for preparation so that the observation can proceed on 
schedule. 

5. Follow the rules that apply to visitors to a school, 
a. Check in with the secretary at the office and tell 
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her that you are from Dr. Cobb's office and will be observing 
In such and such teacher's room from _______ to . When go- 

ing Into a new school, In addition to the above, give your name 
to the secretary. 

b. Some schools have dress codes so It Is Important 
that you dress In a manner acceptable to the school official; 
e.^g., dresses and not slacks for women, and shirt and tie for 
males rather than T shirts. Additionally, grooming Is Important. 
Long hair and beards for males are acceptable If they are trim 
and neat. The schools have agreed to participate In projects 
and In order to maintain satisfactory relationships It Is neces- 
sary that visitors to the school building follow the same rules 
that, apply to the' teachers . 

c. After reporting to the office, go directly to the 
classroom. Plan to arrive approximately five minutes before the 
scheduled observation. Check to make sure that all children 
have numbers pinned on them conspicuously; If not. Inform the 
teacher. Check with her (him) on the seating arrangement for 
the observational period; as soon as the children are In an- 
activity area, make a seating plan putting the children's num- 
bers on the appropriate spaces. When further observations are 
to be made In the same classroom your diagram will be ready and 
will only require filling In each child's number. 

d. When you enter a classroom a minimal amount of. con- 
versation should occur between you and the teacher or students. 
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This rule Is to be applied at all times, ‘'ome observers have 
been placed In difficult positions x^hen they have been asked for 
advice of a professional nature by teachers concerning difficulties 
x/lth children In the classroom. In order to avoid that possibil- 
ity It Is wise to talk primarily about the simple mechanics of 
the observation; e.g., where to sit, what the seating plan will 
be, who Is absent — and not about particular children's good or 
bad points. This does not mean that you are being unsocial; 
the usual social amenities are exhibited; e.g., "Good morning," 
but no extended conversations are held. Teachers know that these 
rules are In effect so they do not expect lengthy Interactions. 
Likewise, conversations xflth the children do not occur so that 
the observation Is as little affected by your presence as poss- 
ible. As soon as you become an active part of the environment; 
l.e., when children begin to Initiate Interactions with you, the 
neutrality of your presence no longer Is maintained. Children 
accomodate quickly to a neutral observer and continue their 
activities as though the observer were not present. 

B. During an Observation 

1. As soon as you begin coding, few Interruptions should 
occur. The Importance of gathering a continuous flow of data In a 
highly variable environment cannot be overemphasized. In the class- 
room the situation can change very rapidly from one In which the 
teacher Is lecturing to one In which she may be asking questions and 
In the next few moments having children read aloud. Because of this 
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phenomena It Is necessary to sample as many children as possible under 
each o€ these conditions. 1£ the time Is spent In preparatory activ- 
ities; e.g., numbering pages, sharpening pencils, etc., then data Is 
Irretrelvably lost on some children and, as a result, the analysis 
will be less complete. 

2. Children should be coded In the most convenient order 
for you to ptdduce maximum amounts o£ data. The teacher may not have 
the children seated In order of their assigned numbers In which case 
you should observe using the existing order. For example. In Indi- 
vidual seut work the children may be In rows and the numbers of the 
children In the first row are 1, 12, 8, 3, 4, and 7. You should code 
using the existing arrangement rather than coding number 1, and going 
to number 3;, then to number 4, etc. This arrangement will vary from 
day to day as the teacher changes the children's seats. The Impor- 
tant aspect Is to have the data collected on all children In the 
same order during an observational session. Thus, In the above 
example, after all children have been coded once, you would be- 
gin coding In the same order again until the observations are com- 
pleted for that day or the children moved Into another activity area. 
If the latter occurs, you begin a different sequence depending upon 
the placement of children In the new area. For example, the chil- 
dren may go from. Individual seat work to a reading group and be seated 
In a different order. Rather than sticking to the former sequence 
of coding children that had been used In Individual seat work, you 
code the children according to the new seating arrangement. 
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3. I'lhen two or more observers are coding In a classroom 

1 

there should be as little Interchange as possible. Talking among your 
selves should occur only in unusual circumstances; e.g., If an obser- 
ver has broken both pencil points. Talk about the teacher, the chil- 
dren, the codes, or the functioning of auditory devices should never 
occur. The less the distraction caused by observer Interaction, the 
less the possibility of obtaining biased data. By having prepared 
for most contingencies that can occur during an observation, you are 
freed from unnecessary Interaction during the observation Itself. 

C. Following an Observation 

1. You leave the classroom as quietly as possible, stop 
at the office before leaving the school and tell the secretary that 
the observation Is complete. 

2. All equipment Is returned to the office and information 
completed on all sheets. 

3. At the office, you can make any corrections that were 
not made in the classroom. Sometimes In thinking about a particular 
coding sequence you may want to replace the code that was used with 
one better describing the behavior exhibited by the person In the 
classroom. 

4. Enter any coding questions In the log book. These will 
be answered and discussed during observers' meetings. It sometimes 
happens that an existing code ^es not seem to describe the situation 
that Is being observed. By writing this down Immediately following 
an observation the likelihood of forgetting decreases and the infor- 
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nation gained regarding the Incompleteness of the current system will 
aid In making subsequent revisions. 

5. In a notebook record the Impressions received during 

the classroom observation. A paragraph or two describing the sltua- 

\ 

tlon as specifically as possible x^^lll help the psychologist x^'orklng 
with the teacher In the classroom. 

The Coding Sheet 

Each coding sheet consists of a heading and six blocks of coding 
symbols. (See Appendix for copy of observation sheet.) In the upper 
right hand corner beside the word "Page," number each page sequen- 
tially for each group during an obseirvatlonal period. For example, 
when all children In the classroom are being observed for the entire^ 
session, you be>;i;in with the number "1" and sequentially number each 
successive sheet used until the observation Is completed. Uhen dif- 
ferent groups of children arc observed during the academic period, 
the sheets are sequentially numbered beginning with the number "1" 
for each group. For example, consider two observers In a classroom 
during reading while the teacher has sea two rk and small reading groups 
ocurrlng simultaneously. Each observer codes a different group of 
children and each numbers the first coding sheet "1", the second "2", 
etc. When the children switch from one situation to another, so that 
the reading group Is now engaged In Individual seat work and the other 
children are In a reading group, each observer continues the same sheet 
numbering sequence for each group. One observer Is on page "21" when 
the children switch, then the next page In the changed activity la 
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numbered ‘'22''. By using a sequence of numbering It Is possible to 
tell during which part of the period one activity occurred for each 
group of children. Before and during the observation you should num- 
ber all the sheets that are used. This process protects against the 
possibility of sheets being out of order. In one analysis^ the data 
Is examined by looking at the change of behaviors within an academic 
period; . If the sheets are Improperly ordered, the analysis will be 
Invalid . 

Beside the word ''Date", you record the day, month and year that 
the observation occurs. The year Is necessary as some classrooms 
are observed for more than one year. Beside the word "Observer", 
place your Initials. Beside 'Time", record the time the observation 
began on the coding sheet numbered "Page 1" and disregard the time 
on all other sheets except the last numbered sheet. On the last num- 
bered coding sheet the time should be entered. If you use "Page 1" 
more than once during an observation, then the appropriate time should 
be entered on the first and last numbered sheet of each. series. The 
teacher's last name should be placed In the space provided beside 
the word "Teacher". 

Classroom Settings 

The next five words are used to grossly define the classroom 
situation. They are defined as follows: 

Structured ; The teacher has provided clear and specific guide- 
lines for the children's activities. For example, the teacher has 
given clear Instructions to the children about the work to be done 
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at their desks and the acceptable activities that can be engaged In 
once the work has been completed. 

Unstructured ; The guidelines • for the children's activities are 
vague and non-specific. For example, the children are engaged In 
various non-supervlsed activities In the classroom and they determine 
what they are going to ^do. 

Group ; The majority of children being observed are engaged in 
a group activity. Examples Include children sitting In a small read- 
ing group, and the entire class listening to the teacher lecturing 
or a child reciting. 

Individual : The malorlty of children being observed are engaged 

In Individual as opposed to group activity. Individual Includes soli- 
tary work as well as two or three children working together. Children 
working on assignments at their desks and children x^orklng In pairs 
on assignments are some examples. 

Transitional ; Tlie majority of students being observed are between 
activities within a period, between academic periods, or between non- 
academic periods. Examples Include children moving from a reading 
group to work on Individual assignments during a reading period, chil- 
dren changing from a reading period to an arithmetic period, and chil- 
dren preparing to go to recess at the end of a reading period. 

Coding Behavior 

Hlthln each of the six coding blocks there are four lines of 
behavioral codes. The first line is reserved for peer antecedent be- 
haviors that are directed at the subject . Otherwise the line is not 
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marked. 

The second line is reserved for teacher antecedent behaviors 
directed at the subject or a peer. The third and fourth lines are 
used for the behaviors of the subject as well as the consequent be- 
haviors by the peers and/or teacher. 

The five explanatory symbols on the right hand side just above 
the behavior codes designate the appropriate symbols to be placed 
over the codes during observation. These are used to Identify the 
source and direction of each behavior. 

A circle ( 0 ) refers to behaviors Involving the Subject . When 
used on lines one or two as peer or teacher antecedent behaviors, 

It refers to behaviors directed at the subject. When used on lines 
three or four, It refers to subject behaviors. 

A horizontal line ( — ) refers to behaviors Involving Peers . 

On the second line, this symbol signifies teacher behaviors directed 
at a peer which Is antecedent to the subject's behavior. On the third 
and fourth lines. It refers to peer responses to subject behaviors. 

A vertical line ( 1 ) through a code refers to Teacher behaviors. 
When used on the second line as a teacher antecedent behavior. It re- 
fers to teacher behavior which does not Involve the group being ob- 
served. On the last two lines It Indicates the teacher's response 
to a subject behavior. 

An ( X ) ref'*rs to teacher antecedent behavior directed at the 
Group . which always Includes the subject and Is coded only on the 
second line. 
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A check-mark ( signifies the occurrence of a Teacher-to-Peer 
behavior folloi^lng the occurrence of a subject response. This can be 
coded only on the last two lines of the coding block . For example, 
the teacher asks the subject a question to x^hlch he responds Incorrectly. 
The teacher then asks a peer the same question. The teacher's second 
behavior Is coded by placing a check-mark on the symbol for question 



More than one symbol can be placed over a behavioral code. For 
example, the teacher and several peers are looking at the subject as 
he writes an answer on the blackboard. The code for' teacher and peers 
behavior would be attending ( AT ) and a vertical line ( | ) for teacher 
as well as a horizontal line ( — ) for peers would be placed on AT 
on the third line of the coding block, l.e. ( ). 



Tlie proper sequence of coding behaviors Is Imperative not only 
for observer reliability to be maintained at high levels but also for 
creating meaningful data bank. The data bank Is used for analysis of 
Intervention effectiveness, of peer and/or teacher behavior Influence 
on subject behavior, and of other questions both practical and theo- 
retical. The sequencing should follov; the outline provided below. 

(See Figure 1.) (Page 12a.) 

An explanation of the steps follows: 

1. Locate the subject : When coding, the first task Is to lo- 

cate the child to be coded. In some cases this act will take a second 
In that the child will be In close proximity to the previous child for 
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which coding has been completed. By setting up the observation (see 
page 4) to minimize the time spent in locating the children more data 
can be gathered. 

2. Push Reset Button : As soon as you locate the child depress 

the reset button. This saves time and you can immediately begin ob- 
serving the interaction that is to be coded rather than x^altlng for 
the auditory click xdilch occurs every eight seconds. 

3. Observe Peer Behaviors : This phase consists of determining 

whether peer behaviors are being directed at the subject; other behav- 
iors of the peers are not coded. 

4. Observe Teacher Behaviors ; Look at the teacher’s activity 
the teacher's behavior is coded even when it does not Involve the sub- 
ject. 

5. Observe Subject's Behaviors ; The next step is to observe 
x<7hat the subject is doing. 

6. Code ; At this point use the applicable codes to depict 
the observed activities of peer, teacher, and subject. If the peer's 
behavior was directed toward the subject, the behavior is coded within 
the first line — otherwise the first line remains blank. The teacher's 
behaviors are coded on the second line and the subject's behaviors 

in the third or fourth line. Code as many behaviors as were observed 
for subjects, peers and teacher. For example, if the subject was 
exhibiting three behaviors that are defined by the coding system, 
all behaviors should be coded. 

7. Observe Peer Responses ; After coding the subject's behavior, 
scan the classroom to determine If any peer responded to the subject's 
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behavior. 

8. Observe Teacher Responses : Check to see If the teacher re- 

sponded to the subject's behavior. 

9. Code t The observed responses are then coded In lines three 
and four of the same block v;hlch t.’as used in step ^ 6 . Code as many 
responses as occurred. At least one teacher's response must be coded 
in every block ; the peer's responses are only coded if they were di- 
rected to the subject. 

10. Has only one block been used during the eight second period? 
If you have used one block for coding, then the next step is #11; if 
you have used more than one block, go to step #13. 

11. Observe Teacher's and Peer's Behaviors directed to the Sub- 
ject and Subject Behaviors . Oftentimes within an eight second period 
behavioral change occurs and you have time to code the changes before 
the end of th& eight second period. By continuing to observe the 
subject, teacher and peers after step #9 you can gather valuable data. 

12. Does Behavior Change? If the behavior of teacher, peer 

and subject remains the same, proceed to step #13. Otherwise, return 
to step #6. In returning to step #6 use the next coding block on the 
observation sheet and record in the following manner: code peer be- 

haviors on the first line they are directed to the subject, teacher 
behaviors on the second line only when there is a change in the be- 
havior from the response coded in the previous block. From step #6 
continue through each successive step, l.e. , #7, 8, 9, until reach- 
ing step #10 which leads then to step #13. 
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13. Walt for Auditory Signal ; If the behavior has not changed 
or you have coded two blocks since the last auditory signal, wait 
for the next signal while preparing for the next step. 

14. Has only eight seconds elapsed ?- If the subject has been 
observed for only eight seconds, return to step #3. A slight vari- 
ation occurs In the second coding; If all behaviors are the same, 
place a diagonal line through the entire block that has already been 
coded. The diagonal line Indicates that no changes occurred In either 
the peer's subject's or teacher's behavior. If after placing a diagonal 
line a change does occur, then step if 6 should be followed using a new 
coding block. 



occurring and the response of the teacher (which has been coded In 
the previous coding block) serves to elicit behavior of the subject, 
then the Teacher Antecedent Behavior line does not- have to be coded 
even though an auditory signal occurs. Thus, It Is possible to code 
a teacher consequence, hear the auditory signal, and Immediately code 
a subject response In the next block without coding a prior Teacher 
Antecedent Behavior. 

15. Has only 16 seconds elapsed? If the subject has been observed 
for 16 seconds move to step #16. However, If the subject has been ob- 
served for 24 seconds proceed to step #17. In no case are subjects 
to be observed for longer than three consecutive eight second periods. 

16. Is the Interaction completed? If there Is a continuing 



Additionally, If a subject- teacher Interaction has been 



Interchange occurring between the teacher and the subject, return to 
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step #3 and go through the entire sequence again from step #3 through 
^ 15 * This provides Important data on the nature of the total Inter*- 
actlon between the subject and teacher whenever possible. Even after 
coding an additional eight seconds for a total of 24 seconds the inter- 
action may still not be completed. Place the code letters II (Incom- 
plete Interaction) next to the code NR on the fourth line of the last 
coded block. Twenty-four seconds is the maximum time allowed in order 
to be able to code as many children as possible. 

17. Is the academic period finished? If the academic activity 
continues proceed to step #18, otherwise to step #19. 

18. Locate the next subject . Look for the next child to be coded 
and return to step #2. 

19. STOP: The academic period is completed and the observation 

Is over. 

Definitions for Observation Codes 

PEER ANTECEDENT BEHAVIORS 
AT Attending to the Subject : 

Peer is In close proximity and looking at the subject, l.e., 
peer is not across the room from the child but close enough so 
that social interaction Is possible. 

IS+ Interaction with the Subject about Academic Material : 

Peer is talking with the subject about relevant academic 
material, i.e., academic material that Is being taught during 
that academic period. For example, a peer talking with the 
subject about mathematics during a reading period would not be 
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considered IS+ unless the children have the approval of the 
teacher. 

IS- Interaction with the Subject about Non-Academic Material ; 

Peer talks with the subject about non-academic material or 
about academic material that Is not related to the period In 
which the observation Is occurring. Examples are children 
talking about the lunch menu, "Wild Kingdom", father's new car, 
dogs, cats, etc. This code does not apply If such topics are 
considered academic by the teacher. In many language experience 
programs children will talk about such subjects as part of a 
planned curriculum and In .such cases .the conversation would be 
coded IS+. Children discussing reading during math periods 
would be coded IS- unless the teacher has given permission for 
such activity. 

PI Peer Initiation ; 

Peer Is the person who Initiated an IS+ or IS-. If the 
subject Initiated the Interaction or the observer does not know 
who Initiated the Interaction then PI Is not used; the appropri- 
ate code Is IS+ or IS-. 

DS Disruptive Behavior to Subject ; 

The behaviors constituting this category are fairly Intense 
and likely to provoke some censure from other people In the 
classroom. Hitting, threatening or yelling at the subject are 
the prime behavior that fit this category. 
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TEACHER ANTECEDENT BEHAVIORS ; 

QA Question Academic ; 

Teacher Is asking a question » verbally or nonverbally » the 
content of which Is academic. The verbal aspect need not be 
stated In the form of a question but can be determined also by 
the Inflection In the teacher's voice. For example » In a read- 
ing group the teacher says, "The boy ran to the store," rather 
than "Did the boy run to the store?"; the Inflection of the word 
"boy" plus a short pause after the word "boy" would Indicate 
that the first statement was actually a question. Thus, a ques- 
tion clearly stated or an Inflectional statement which Implies 
a question are both coded as QA. Nonverbal questions are gestures 
used by the teacher that Indicate an answer Is expected. Examples 
are the presentation of flash cards and pointing to words on the 
blackboard. 

QM Question Management ; 

Teacher Is asking a question relating to activities that 
generally precede academic responses. The difference between 
academic and management can be determined by the nature of the 
response that Is expected. For academic categories an academic 
response Is required and for a management category the expected 
response Is one that sets the stage for academic responding. 
Examples of management questions are: "Does everyone have their 

book open to page 23?", "will you bring your chairs to the read- 
ing group?", "Do you have your pencil?" The same rule regarding 
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Inflection applies here, l.e., the teacher may make a statement 
that transcribed would Indicate a declarative sentence but by 
listening to Inflections the statement Is actually a question. 

QD Question Discipline ; 

Teacher Is asking a question regarding the content and form 
of classroom social Interactions, personal conduct, or the hand- 
ling of classroom materials. Examples are: "is It necessary 

for you to talk so loudly and bother your neighbor?", "What did 
I say about the number of children at the pencil sharpener at 
one time?, "Do you always have to run Into the room when you 
return from recess?" The distinction between Questions Disci- 
pline and Questions Management occurs by the non-academic quality 
of the former as opposed to the latter. For example, the teacher 
may want the children to have their pencils sharpened In order 
to do some academic tasks so the question Is asked, "Does every- 
one have their pencils sharpened?". Several children respond 
In the negative and rush to the pencil sharpener and the teacher 
asks, "Nhat are you ALL doing at the pencil sharpener at one 
time?". The first question Is QM and the second Is QD. 

CA Comnand Academic : 

The teacher will make a statement for ''>ilch an academic 
response Is expected. Examples are: "Tell me the number of 

different people that are In the house that Jack built." "Tell 
me the vowel names." "Do the problems on page 55." 

CM Command Management : 

A management command can occur as part of a preparation for 
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an academic activity or during the activity itself. For ex- 
ample, the command, "Bring your chairs to the reading group," 
occurs before reading actually begins; the command, "Turn to the 
next page," can occur during the academic activity but the child's 
response does not have to -be academic in order for compliance 
to occur. The child can turn the page which indicates compliance 
but this dpes not ensure that the child is going to read the 
page. 

CD Command Discipline ; 

The teacher gives a command whose content relates to the 
content and form of social Interactions, personal conduct and/ 
or the handling and treatment of classroom materials. Examples 
are; "Sit quietly in your seats while I go to the office." 

"Don't make any marks in your books or write on your desks." 

"Leave the room." "I don't want you to rub your eyes." "Fold 
your hands in your lap." 

AT Attention : 

The teacher looks at the subject or engages in other be- 
haviors that generally indicate that she Is paying attention to 
the child. For example, the child is reading aloud and the 
teacher follows in her book or looks at the child. The child 
is working at seatwork and the teacher leans over the child's . 
shoulders and examines the work. 

LC Lecture ; 

The teacher Is imparting academic information to the students 
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without immediate feedback from the students. For example, the 
teacher tells the students about the rules governing sounds, 
cursive writing, adding numbers or multiplying. The lecture need 
not be extended over a long period but can be as short as a minute 
or less-- the defining characteristic is the lack of interaction 
with the students when the teacher is presenting information. 

RD Reading Aloud ; 

Teacher is reading aloud to or with a student or students. 
The reading may be from a book or from any teaching aides; e.g., 
blackboard, charts, etc. Simply following in a book as a student 
reads, without reading aloud, would be coded AT. 

TT+ Talk About Academic Material ; 

The teacher is discussing academic material with a student. 
For example, the teacher Illustrates the difference in the sound 
of a vowel preceded by certain consonants, or the difference be- 
tween b and d. The distinction between this category and LC is 
the student variable. With TT+ the teacher is interacting with 
the student whereas in LC minimal Interchange is occurring. 

TM Talk About Management ; 

The teacher is talking to the students about activities 
preceding academic responses. For example, the teac'iier may say, 
"I want to work out a system for your bringing your seats to the 
reading group. I think if we have the previous group leave some 
of their chairs it will make, it easier for you," or "We need 
to have more workbooks available." "There are not enough pencils 



Cobb 



22 




to go around." "We should have the books opened to the right 
page when we begin reading." 

TD Talk about Discipline ; 

The teacher is talking to students about content and foinn 
of social interaction, personal conduct, and/or the handling of 
classroom materials. Examples include: "I want to see if we 

can help Johnny to be quieter." "This class was noisy today." 
"Too many people are out of their seats during the time you were 
supposed to be working at your desks." 

TT- Teacher Talks about Non-Academic Material : 

Use of this category applies to teacher's verbal behavior 
when the content is non-academic. The non-academic quality re- 
fers to subject matter not pertinent to the academic period in 
which the observation is occurring. For example, talking about 
mathematics problems during reading is coded TT-. A more fre- 
quently occurring phenomena is talking about lunch programs, 
plays, personal experiences, and non-related school activities 
when an academic period is in progress. For those situations 
in which any of the above' topics are appropriate to a particular 
curriculum approach; e.g., language experience programs, then 
the code TT- is not to be coded. Instead the code TT+ should 
be used. 

AP Approval : 

The teacher gives clear verbal, gestural, or physical ap- 
proval to the students. The verbal Include statements contain- 
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Ing praise for the student's work, attitudes, appearance, and/ 
or conduct; It does not Include simple feedback as to the correct- 
ness of an academic response; e.g., "That answer Is right," unless 
the statement Is said with emphasis; e.g., "That's right!" Ges- 
tural behaviors Include smiles, nodding of the head and clapping 
of the hands. Physical approval Includes hugs, pats on the back, 
and other physical contact of a positive nature. 

DI Disapproval : 

The teacher gives clear verbal, gestural, or physical dis- 
approval of the student's behavior or characteristics. The ver- 
bal Include statements containing dislike, disgust, dismay, un- 
happiness, and/or perturbation over the student's work, attitudes, 
or appearance; It does not Include simple feedback as to the In- 
correctness of an academic response; e.g., "That's wrong" unless 
the statement Is expressed In derogatory tones. Examples of ^ 
statements that fulfill the criteria are: "I don't like that tone 

of voice." "You didn't pass In your homework on time." "Your 
work Is sloppy." "Why don't you get a haircut." "Can't you ever 
sit quietly— just for one minute." Gestural behaviors Include 
frowns and shaking of the head. Physical Includes hitting, spank- 
ing, pulling hair and tugging at the arm. 

DS Disruptive to Others ; 

In this category behaviors that are likely to be disruptive 
are Included. They Include yelling, hitting, noisiness, spank- 
ing, pulling hair, tugging at a student's arm, pulling the student 
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bodily and banging objects. For example, the teacher may find 
a child engaged In a fight In the classroom, and will throw an 
object at the child or bang a book on the table or bodily pull 
the child away from the fight. 

OT Other Teacher : 

The teacher Is engaged In activities not Involving the group 
of students being observed. She«may be working alone at her desk, 
talking to visitors, answering questions from students who are 
not part of the group she Is teaching, or out of the room for a 
few minutes. 

TG Teacher Involved with Small Group Work : 

This category Is coded when the teacher Is Involved with 
other groups of students for extended periods of' time while a 
different group of children are being observed. For example, 
the children being coded are doing Individual seatwork and the 
teacher Is working with a different group of children on oral 
reading. Details of the teacher's Interaction with the group not 
being observed Is Irrelevant and need not be coded. However, 

If the teacher begins to Interact with any of the children being 
observed, TG Is not coded; another more appropriate teacher ante- 
cedent behavior Is used. For example, the teacher may tell one 
of the students In the group being observed to be quiet and CD 
would be coded. 

The^ distinction between TG and OT Is that In TG the teacher 
Is primarily Involved In teaching a group of students that are 
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not being observed whereas In OT the teacher Is Involved with 
the group being observed, but momentarily distracted by other 
events, or Is working alone without student Involvement. 

^ SUBJECT RESPONSES AND PEER/TEACHER CONSEQUENCES 

The subject responses defined below are also applicable to peer 
and teacher consequences which result 'from the subject responses. 
Rather, than going Into extensive detail and giving numerous samples 
of the subject responses when they are employed for teacher or peer 
consequences,.. examples have been given, for only those -coda, categories 
that might causa .some confusion In application. For the other cate- 
gories .examples., are presented .only for the subject. It Is assumed 
that the applicability of the codes as peer or teacher consequence 
Is clear* enough that examples.ere unnecessary. The general rule Is 
that most codes, listed can be applied to subject behavlors-.as well 
as to peer and/or teacher consequences. The prime -criteria, for apply- 
ing the codes, to- reachers or peers Is that the teacher and/ or peer 
has engaged In. the behavior. as a result of the subject's actions . 

'The, interact ion. J>etween peers and teacher Is irrelevant for the cod- 
ing-system unlesa- It stems- directly-'from the. subject's, behavior. An 
example may clarify the .meaning. The teacher has asked a question 
to the subject^and.^her -behavior, has- been' coded on. .the second line of 
the coding block. The subject gives a wrong answer and a peer Imme- 
dlatelyglves the correct ..answer... In.,this-caseboth the .subject's 
behavior and the peer's behavior are coded as the peer's behavior 
followed from the incorrect answer given by- the subject. If the 
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teacher had asked a peer the question and the subject was attending 
while the peer gave the correct answer, her behavior would have been 
coded on the second line. The subject's behavior would have been 
coded, but the peer's behavior would not have been. The distinction 
Is that the peer behavior In the first example resulted directly from 
the subject's behavior but In the second Instance It was the result 
of the teacher's behavior. Thus, In exai^nlng and applying the follow" 
Ing definitions, It Is Important to keep In mind that the behavior 
can apply to all agents but Is only coded for peers or teachers when 
their behavior Is a direct result of the subject's behavior. 

AT Attending ; 

To be a subject response the subject should be looking at 
the teacher when the teacher Is talking, looking at any materials 
In the classroom that have to do with the lesson, and engaging 
In other behaviors appropriate to the academic situation. Some 
examples of AT being a subject response are the child looking at 
the blackboard when the teacher Is going over words, watching 
other children when they are writing at the blackboard, walking 
to the pencil sharpener, and taking materials out of the desk 
to use In the academic session. AT Is also coded If the child 
has finished the assignment and Is engaging In activities ap- 
proved by the teacher. 

To be a teacher or peer consequence the behavior need not 
be In regard to academics, l.e., teacher or peer looks at the 
child or engages In other behaviors that Indicate they are paying 
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attention to the child. For exaiople, the subject can be engaging 
In horse play and the teacher and/or peers look at the child; the 
child Is reciting and the teacher and/or peers look at the child 
or follow along In their books as the child reads. Both cases 
would be coded AT for the peer and/or teacher consequences. 

LC Lecture ; 

The teacher Is Imparting academic Information to the stu~ 
dents without Immediate feedback from the students. For example, 
the teacher tells the students about the rules governing sounds, 
cursive writing, adding numbers or multiplying. The lecture need 
not be extended over a long period but can be a minute or less-*- 
the defining characteristic Is the lack of Interaction with the 
students when the teacher Is Imparting Information. 

RD Reading Aloud ; 

The subject, peer or teacher Is reading aloud. This can 
be done Individually or as part of a group recitation. For ex- 
ample, the teacher asks the children to read words from the 
blackboard and the subject as well as other children read the 
words, the teacher asks the subject to read a passage from a 
reading book and the subject does so. 

KK Working : 

The subject or peer Is working on academic material with- 
out any overt verbal components, either In a group or Individual 
seatwork situations. Two examples are: the child following 

along In a reading book as another child reads a passage. 
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and the child writing answers in a workbook. Any activity that 
Is considered part of the academic curriculum by the teacher 
Is considered work If the child Is engaged In the activity with- 
out any overt component. For example, coloring, painting, and 
completing puzzles are considered WK In reading periods when the 
teacher designates such activities as part of the reading program. 

AQ Answers Question ; 

The subject or peer answers a question posed by the teacher, 
but the observer cannot make out whether the answer Is right 
or wrong. 

RT Right Answer ; 

The subject or peer gives a correct answer to an academic 
question by the teacher. 

IJR Wrong Answer ; 

The subject or peer gives an Incorrect response to an aca- 
demic question by the teacher. 

DK Don* t Know ; 

The subject or peer Indicates that he does not know the 
answer In a verbal or non-verbal manner. For example, the child 
shakes his head, says, "I don't know", or sits and says nothing 
In response to a question. 

IT Initiate to Teacher 

Subject or peer Initiates or attempts to Initiate an Inter- 
change with the teacher that Is not In conjunction with VO, vol- 
unteering. For example, the student may go to the teacher's 
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desk during Independent study or raise his hand to seek assis- 
tance regarding the clarification of instructions about an 
assignment. The peer may approach the teacher following an in- 
terchange with the subject. 

CL Call Out ; 

The subject or peer calls out an answer when a question is 
directed to another student or the student Interrupts the teacher 
or another student when they are talking. For example, the 
teacher is explaining the reading workbook's purpose and the 
subject Interrupts by saying, "I saw that workbook on your desk 
last week." Or the teacher asks a question to another student and 
the subject gives the answer without letting the other student 
respond . 

VO Volunteering ; 

By verbal or non-verbal means, the subject or peer exhibits 
behaviors associated with volunteering information of an academic 
nature. For example, the student raises a hand in response to a 
group directed question by the teacher; the student answers a 
question directed at the group; the student calls out an answer 
or provides other information pertinent to the discussion. 

QA Question Academic ; 

The same definition applies as in Teacher Antecedent Be- 
haviors except that peers, subject and teachers can exhibit 
the behavior. For example, the subject might ask the teacher 
how to spell a word, or the peer might ask the subject a question. 
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QM Question Management ; 

Same as in Teacher Antecedent Behavior except that the 
code is applicable to the subject, peers and teacher. 

QD Question Discipline ; 

S2ime as QD In Teacher Antecedent Behaviors except the code 
Is applicable to the subject, peers and teacher. 

CA Command Academic ; 

Same as CA In Teacher Antecedent Behaviors except the appli- 
cation of the code Is to subject, peers and teacher. 

CM Command Management ; 

The definition Is similar to CM In Teacher Antecedent Be- 
haviors except the applicability Is broader to Include peers 
and the subject as well as the teacher. 

CD Command Discipline ; 

Same as CD In Teacher Antecedent Behaviors except the code 
applies to subject, peers and teacher. 

TT+ Talk About Academic Material ; 

The definition Is the same as applies to TT-f In Teacher 
Antecedent Behaviors except the code's applicability Is ex- 
tended to the subject and peers as well as the teacher. 

TM Talk About Management ; 

The definition given under Teacher Antecedent Behaviors 
applies but Is extended to peers and subject as well as the 
teacher. 

TD Talk About Discipline ; 

The definition given under Teacher Antecedent Behaviors Is 
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applicable and Includes peers and subjects* 

TT- Talk About Non-Academic Material ; 

The definition Is the same as applies to TT- In Teacher Ante- 
cedent Behaviors and applies to the subject and peers as well 
as the teacher. 

SI Subject Initiates; 

The subject Initiates an Interaction (IP^ or IP-) with a 
peer rather than the peer Initiating an Interaction with the 
subject. The code Is only used when the observer knows that the 
subject has been the Initiator. 

IP+ Interaction with Peer about Academic Material : 

The subject Is Interacting with a peer or a peer Is Inter- 
acting with the subject about academic material that Is appro- 
priate for the academic period In which the observation occurs. 

The Interaction can be either verbal or non-verbal. Examples 
are: the subject and peer discussing Instructions for carrying 

out a reading workbook assignment, the subject and peer working 
on an arithmetic problem together. 

IP- Interaction with Peer about Non-Academic Material : 

The subject Is Interacting with a peer or a peer Is Inter- 
acting with the subject about academic material Inappropriate 
for the academic period In which the observation occurs (unless 
approved by the teacher) or about non-academic material. The 
Interaction may be verbal or non-verbal. Examples are: the 

subject and peer doing reading assignments during the arithmetic 
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period or the subject and peer talking about a new bike. 

DP Disruption Peer : 

This category Is defined In the same way as DS under Peer 
Antecedent Behaviors except that the person engaging In the 
behavior can be either the peer, teacher or subject. For ex** 
ample, the subject can hit the peer and the peer In return hit 
the subject. 

DT Disruption Teacher : 

The subject, teacher, or peer are engaging In disruptive 
behavior as defined by DS under Teacher Antecedent Behaviors. 

For example, the subject can yell at the teacher, or the teacher 
may pull the subject's hair. 

DA Disruption All : 

The subject, teacher or peer are exhibiting disruptive be- 
haviors, l.e., fairly Intense behaviors like yelling, throwing 
objects, running, that actually have the possibility of strongly 
disturbing more than one peer or the teacher. For example, the 
subject bangs a book on the desk, or the peer shatters a piece 
of chalk against the blackboard, or the teacher yells at the 
subject, "Get back In your seat, or else I'll send you to the 
principal's office!" 

PL Play Inappropriate : 

The subject or peer Is playing and that activity Is In- 
appropriate as defined by the teacher. For example, the child 
Is playing tic tac toe with another student while Individual 
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seat work Is going on, the subject Is doodling, or the subject 
is running a toy truck on his desk. Such activities are not con- 
sidered PL if the subject or peer has completed his work and the 
teacher has specifically stated that play is appropriate. If 
the subject has not completed his work and Is playing, then PL 
is the applicable code. 

IL Inappropriate Locale ; 

The subject or peer Is in a classroom area that is not 
appropriate for the academic activity that is going on at that 
time. For example, the subject is walking around the room when 
individual seat work is occurring; Instead of joining a reading 
group, the subject stays at the desk. 

LO Look Around ; 

The subject, peer or teacher is looking around the class- 
room environment or staring at something or someone that Is not 
relevant to the current academic activity. For example; the 
subject looks out the window as other children are playing dur- 
ing their recess, stares at another child across the room when 
individual seat work has been assigned, or looks around the room 
from object to object while another child is reading aloud. 

SS Self-Stimulation 

The subject is moving parts of the body to such an extent 
that engagement in academic activities is precluded. The child 
scratches an arm, rubs the nose, swings the feet, squirms in 
the chair, to such an extent that attention is directed at the 
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body rather than on the academic material. The "normal" squirm- 
ing and movement of the body Is not coded, only those Instances 
In which the child Is totally engaged In the stimulatory activity. 

NA Not Attending ; 

The subject Is In the appropriate area but Is looking at 
other things In the Immediate environment than those aspects rele- 
vant to the current academic activity. For example, the teacher 
Is explaining a lesson but the student Is thumbing pages In the 
book; a peer Is reciting but the subject Is working on academic 
material from another academic period without the permission 
of the teacher; the subject ties a shoe while other children are 
reading silently In a reading group. The distinction between 
the category LO Is the aspect of the environment that Is being 
Investigated by the child. For LO to be coded the environment 
Is more than a few feet from the child; for NA the boundary Is 
Inside that few feet, '(hus the child may be staring at the desk 
and that would be coded NA, but If staring was directed at another 
child's desk then the code Is LO. 

AP Approval : 

The same definition applies as that given for AP In Teacher 
Antecedent Behaviors except that the AP Is applicable for sub- 
ject, peer and teacher. 

SC Second Chance ; 

In a variety of ways the teacher gives the subject or peer 
a second chance to make an academic contribution after the first 
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attempt was unsuccessful. The teacher may repeat a question, 
re~phrase a question, provide hints, simply wait for another 
answer, etc. For example, the teacher points to a word on the 
blackboard and tells the subject to pronounce It. The subject 
cannot,' whereupon the teacher asks the subject to sound out the 
first letter. 

DI Disapproval ; 

The same definition applies as that given for DI In Teacher 
Antecedent Behaviors except the DI can be exhibited by teacher, 
peer, or subject. 

IG Ignore ; 

The teacher, peer, or subject Indicates by non-verbal be- 
havior that they heard or saw the action of another person but 
are not responding to the behavior of the other Individual. For 
example, the subject approaches the teacher, asks a question and 
the teacher turns her head; the subject hits a peer within view 
of the teacher, the teacher walks away. 

NC Non-Compliance ; 

The teacher, peer, or subject does not do what Is requested 
In a command from another person. For example, the teacher tells 
the student to clean his desk and the subject does not do so; the 
teacher tells the group to put away their books and the subject 
does not. 

When the teacher gives a command to the entire group every 
member of the group Is to be Immediately coded on whether com- 
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pllance or non-compliance occurs. For example, the teacher tells 
the students to come to the reading group, every child that be- 
longs In the reading group Is to be coded; the child does not 
have to complete the action requested, but must behave In such 
a way that the action Is likely to be completed. For example, 
the teacher tells the children to take out their books and turn 
to page 53. The first child to be coded may just be reaching 
In the desk and the behavior Is coded CO, the second child might 
have the book out of the desk and the code Is CO, and a third 
child has not reached Into the desk — the code Is NC. 

CO Compliance ; 

The subject, teacher, or peer is doing what has been re- 
quested In a clearly stated command. For example, the teacher 
asks the subject to close the door and the subject does so. 

NR No Response ; 

The teacher, peer or subject make no observable response 
to the behavior of another individual. The NR category differs 
from the IG category In that IG indicates that the person heard 
or saw behavior of another individual but turned away or pro- 
vided some other behavioral evidence that he did not wish to 
be Involved. NR, on the other hand, means that no response was 
directed at the Individual as the result of an Interaction. For 
example, the teacher .asks the group, "What Is the capital of 
Oregon?", and the subject replies, "Salem"; the teacher looks 
at her answer book and says nothing. 
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S.WLE CODING SITUATION AND PROTOCOLS 

The following Is an enriched descriptive version of classroom 
activity during a first grade reading period. The proper codes are 
Included In the text and the number of the child being coded Is under- 
lined . Completed coding sheets and a sample sheet* are- Included at the 
end_ of the descriptive segment . (Pages 40a through 40e . ) 

The observer, Sharon Denaro, has entered the classroom on Septem- 
ber 17, 1971, and Is going to code nine children's behaviors during 
a small reading group conducted by the teacher, Mrs. Colby. The first 
graders not Involved In the reading group have been given workbook 
assignments to be completed at their desks. The observation begins 
at 9:45 A.M. 

The children are arranged In a semi-circle In the following or- 
der: 1, 7, 6, 9, 4, 5, 2, 8, 3. Sharon begins coding with child 

Child 7 asks child 1 what page they are supposed ‘to be on 
( @ © ) . Mrs. Colby directs an academic question to child 6> 

( -QA: ) . Child 1 tells 7 the page number ( ) and child 7 finds 

the page ( ). Mrs. Colby thanks 1, for helping 7 ( a|p ). (The audi- 

tory signal buzzes. Asterlcks ( * ) are provided on coding sheets 
to Indicate that the buzzer has sounded.) Mrs. Colby asks an academic 
question of the group ( ^ ). gives the answer but it Is wrong ( @) 
Mrs. Colby directs the same question to child 5 ) who gives the 

correct answer. (The buzzer sounds.) 

Child 6 pushes 7 _ (^^ ©)) (Note: Child ]_ is now the subject.) 

who responds by pushing back ( ) and saying In a loud voice. 
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"stop bugging me!" ({6/^). The teacher, who has been asking academic 

questions of the group ( ^)» stops and says to 7, after the outburst, 

"I want you to read the next paragraph." ( c|^ ) (The buzzer sounds.) 

Child 7 reads ( ) while the teacher follows in her book ( At ) . 

The teacher Interrupts and says, "What was the first word in the last 

sentence?" ( ) The child gives a wrong answer ( (^' ) and 6 says, 

"stupid." .( ©f ) The teacher says, "Sound out the word." ( sji? c|\ ) 

(The buzzer sounds.) The child says that he does not know the sound 

( ) and the teacher asks the class if anyone can help with the 

sounds (^ ), (The buzzer sounds.) 

Several children volunteer to help with, the sounds and the teacher 

calls on child 8 to read the next paragraph ( ). Child 6 (new 

subject) is running a car back and forth on his book ( ) . The 

/ • 

car falls on the floor and child 3, who has been watching child 6 . 
laughs loudly ( 9A: ) . The teacher does not respond ( N|k ). (The 
buzzer sounds.) The teacher tells the class it might be a good idea 
to have a Halloween party ( ). Child 6 says he can bring some ^ 

apples ( ^^ ). The. teacher and some peers say that this is a fine 
idea ( ) . (Buzzer sounds.) 

The teacher asks 5 to read ( HfHt ). Child 9 (new subject) looks 
at one of the children who is doing individual seat work ( ) . 

The teacher tells 9 _ to pay attention ( C^ ). (Buzzer sounds.) Child 
2 pays attention ( ) and the teacher returns to following in 

I 

her book as child 5 reads ( Hp ). (The buzzer sounds.) 

Child 4 (new subject) reads in unison with the other children 
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and the teacher ( ). (The buzzer sounds.) One o£ the students, 

\;ho is working at her desk on workbook assignments, raises her hand. 

The teacher asks what she wants ( o|l ). The student asks a question 
and the teacher gives an answer. Child 4 looks at his shoes during 
this period (^^)). The teacher Is still answering the other student's 
question ( ). ( The buzzer sounds.) 

The teacher continues to Interact with the student outside the 
reading group ( ojr ). Child 5 (new subject) tells child 4 they can 
use the dodge ball during recess ( ) . Child 4 says that they 
will have to choose teams ( ■■ I - P -~ ) . The teacher Is busy elsewhere 
( ). (Buzzer sounds.) The teacher looks at the reading group and 

asks \fho wants to read the next paragraph ( Child 2 volunteers 

and begins to read aloud. Child 4 and ^ follow In their books ({^^) 
while the teacher continues to be busy talking to a student outside 
the group ( n|r ). (The buzzer sounds.) 

The teacher and peers follow In their books ( ) as child 2 
(new subject) reads ((S)). (Thie buzzer sounds.) Child 2 continues 
to read aloud ( '^) ) as the peers and teacher follow In their books 
(-a|p-).. (The buzzer sounds.) 

The teacher explains to the class the reason for the use o£ 
paragraphs In stories (^{»^). Child 8 (new subject) attends ((^), 
as do the other children, while the teacher goes on (^ ). (The 
buzzer sounds.) The teacher Is still explaining the use of paragraphs 
( ^ ) with child 8 ( (®) ) and the other children attending (yliC ). 

The teacher asks child 8 how she can know when a paragraph begins 
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from looking at the arrangement of printing on a page ( ) . Child 

^ gives a correct ansv/er ( (R^ ) and the teacher enthusiastically says, 
"That is exactly what I was looking for!" ( ) (The buzzer sounds.) 

Peer 8 looks at ( ^T)) child 3 (new subject) for a moment and 
then tells her that she is on the wrong page ((PI)^[^ ). The teacher 
explains a point about paragraphs to child 2 ( TT+ ) . Child 3 turns 
to the right page ( ) and peer 8 says, "That's the right page." 

( -iP+ ) The teacher continues to talk to child 2 ( }|r. ). (The buzzer 

sounds.) The teacher asks child 3 if she understands the use of 
paragraphs ((^). Child 3 continues to look at her bock and makes no 
response (^^). The teacher repeats the question ( s|c c|a ). (Buzzer 
sounds.) Child 3 still says nothing ((I^); and the teacher then says 
that a pretty young girl like her might have some Idea why paragraphs 
are used in books ( sjc a|? i|t+ ) . Another child volunteers ( ¥& ) to 
explain the use of paragraphs and the teacher stares at child 3 ( a|t ) who 
continues to remain quiet ((^). (The buzzer sounds.) 

Having coded each child In the reading group being observed, 

Sharon again codes Child 1 as the subject. Child 1 Is staring out 
of the window (^0)) as the teacher lectures to the group ( ^^ ). 

(The buzzer sounds.) The teacher continues her lecture ( ) as 

continues staring (^!m). (The buzzer sounds.) 
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RELIABILITY 

All observers need to check themselves frequently to ensure that 
they are recording classroom behaviors as was Intended by the Inves- 
tigators. Individual observers tend to develop their o\m ldlos3m- 
cratlc definitions even after being highly trained. In fact, It has 

i 

been found that pairs of observers drift away from the original defi- 
nitions while still agreeing with each other. For these reasons, con- 
stant monitoring Is crucial for the collection of reliable and valid 
data. 

One way to monitor your observation skills Is to record classroom 
behaviors of the same subjects In conjunction with another observer. 

Using your own and the other observer's coded, sheets, you can compute 
the degree to which the recordings match. The result Is referred to 
as an estimate of the reliability of observer agreement. The higher 
the reliability the greater the agreement between observers and the 
higher the chance that the recordings accurately reflect the behaviors 
they observed. Such checks should occur at every observation during 
training and at least once a week after tr^alnlng has been completed. 

When there are more than two observers on a project using the 
same observation system, two kinds of reliability checks can be made. 

One observer can be established as the "standard" by which all other 
observers are measured, or observers can rotate so that each will get 

t- 

some estimate of his or her agreement with every other observer. In % 

the first example, each observer Is tested against the "standard" 

i 

observer. The "standard" observer should not be selected by arbitrary | 

i 
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decision, but only after demonstrating bigh reliability with a stan- 
dardized video training tape. For example, weekly or monthly train- 
ing sessions may be held using previously recorded and coded video- 
tapes of classroom interaction. The observer showing the highest 
reliability with the videotape can be assigned the role of "standard" 
observer until the next training session. During that period, only 
the selected observer's recordings would be used to test the relia- 
bility of all other observers. 

When a project lacks a "standard" observer, then the observers 
should rotate so that estimates of reliability are obtained between 
all pairs of observers at least once before the same pair of observers 
are checked a second time. In this way, if one observer is having 
consistently low agreements with others the source of the mismatching 
can be investigated. The rotating procedure protects against two 
observers developing mutual idiosyncrasies that result in high rella- 

I 

bllitles for them but unknown reliabilities with other observers. 

For example, if four observers A, B, C, and D were always checked by 
comparing A with B and C with D, no information would be available 
on the reliabilities between A and C, A and D, B and C, and B and D. 

By rotating, each observer is checked with every other observer so 
that idiosyncrasies are less likely to develop. 

Not only must reliability be maintained for the total number i 

of behaviors, but the sequence of events must be recorded accurately yj 

for subjects, peers, and teachers behaviors. For this reason, the | 

agreements and disagreements are calculated for each line of each | 

■< 

, i 

block on the recording sheet* On each line given observers A and B, )i 
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three events can occur: both observers may agree upon the recording 
of a behavior for a particular subject or agent (peer or teacher); 
Observer A may have recorded a behavior for an Individual which was 
missed by the other; or, conversely, Observer B may have recorded 
a behavior for a subject or agent not recorded by Observer A. The 
first event Is an agreement, the other two are disagreements. The 
following are examples: 

If Observer A coded ( AT’ ) as a peer consequence, and on the 
same line Observer B had not recorded an ( AT ) response for anyone, 
then one disagreement Is counted. If, however. Observer A coded 
( AT ) as a peer consequence whereas Observer B coded ( A{r ) as a 
teacher consequence, then two disagreements would be counted (one 
for the peer and the other for the teacher response). Should Ob- 
server B have recorded ( A|T ) as both a peer and teacher response, 
then one agreement as well as one disagreement Is counted (the former 
for the match of the peer's behavior, the latter for the mismatch of 
the teacher's response). Disagreements can occur as a result of 
mismatches or omissions of behaviors as well as mismatches or omis- 
sions of the persons Identified with the behaviors. In every case 
where a mismatch occurs, a disagreement Is recorded. On each line, 
therefore. It Is Important to note and record all of the possible 
agreements and disagreements that can occur. 

How you compute the percentage agreement depends upon whether 
or not a "standard" observer Is used. Two methods are available and 
both will b«5 explained. S’lmply follow the directions as otitllned 
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and use the method appropriate for your project. 

Reliability Using "Standard" 

1. In the margin of each line of the "Standard" observer's 
coding sheets, record the total number of behaviors coded. Note that 
every symbol placed on a code represents a behavior. For example,. 

AT represents a response by the subject as well as two consequent be- 
haviors by the peers and teacher. It Is counted, therefore, as three 
behaviors. 

2. Compute the total number of behaviors coded by the "Standard" 
observer for the entire recording session. 

3. On each line of the other observer's sheet, score one point 
for each agreement with the "Standard". 

4. On each line subtract one point for each disagreement. Re- 
member, there are various ways In which mismatches or omissions may 
occur. 

5 . Calculate the total points for each line of your sheet and 
place the number In the margin. 

6. Add up the totals In the margin for the complete recording 
session. 

7 . Divide ( 6 ) by ( 2 ) and multiply by 100. 

This number represents the percentage agreement with the coding 
of the "standard" observer. 

Reliability Without "Standard" 

1. Use only one observer's sheet for tallying. 

On each line, score one point for any exact agreement be- 
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tween observers • 

3. On each lire, tally one point for any disagreement created 
by the recording of a behavior by Observer A and missed by Observer 
B, and score one point for any disagreement as a result of Observer 
B recording a behavior missed by Observer A. 

4. Add up the total number of agreements. 

5. Add up the total number of disagreements. 

6. Compute the total number of behaviors observed by both ob- 
servers by adding ( 4 ) and ( 5 ). 

7. Divide the total number of agreements ( 4 ) by the grand 
total ( 6 ) and multiply by 100. 

This number will be the percentage agreement between two obser- 
vers when neither one Is the standard. This assumes that each kind 
of disagreement may have occurred and Increases the total In the de- 
nominator. 

The reliability estimates may be conq>uted for any part of the 
recording sheet. When low reliabilities are occurring In the field 
or during training, It Is Important to determine where the mistakes 
are located. The percent agreements may be calculated separately for 
peer antecedent, teacher antecedent, subject behavior or peer and 
teacher consequences. This Is simply carried out by calculating only 
the percent agreements for each category separately. For example, 
we found that It Is possible to have high reliabilities on subject 
behavior and at the same time have many disagreements on teacher ante 
cedents. This may be currccred by checking the rules given earlier 
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about the correct sequence for recording the total Interaction. 

It Is also Important to determine the reliabilities for each of 
the behavioral categories since those categories which consistently 
produce low reliabilities may be subject to greater individual Inter- 
pretation and need checking frequently. For any computation, proceed 
with the steps previously outlined to obtain a reliability estimate 
for the total recording session or for a specified segment of the ses- 
sion. In each case, calculate the number of agreements and disagree- 
ments on each line, and compute the totals using the appropriate cal- 
culation for your system. 

GOOD LUCK!!!! 
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FOOTNOTES 

1. Joseph A. Cobb, Ph.D. , Is Director, Program II, at CORBEH 
and Research Associate at the Oregon Research Institute. 
Hyman Hops, Ph.D., Is Principal Investigator of Program II, 
Project A, at CORBEH and Research Associate In the Depart- 
ment of Psychology, University of Oregon. 
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